Inverse Data-Driven Optimal Control for Nonlinear Stochastic Non-stationary Systems

We consider the problem of estimating the possibly non-convex cost of an agent by observing its interactions with a nonlinear, non-stationary and stochastic environment. For this inverse problem, we give a result that allows to estimate the cost by solving a convex optimization problem. To obtain this result we also tackle a forward problem. This leads to formulate a finite-horizon optimal control problem for which we show convexity and find the optimal solution. Our approach leverages certain probabilistic descriptions that can be obtained both from data and/or from first-principles. The effectiveness of our results, which are turned in an algorithm, is illustrated via simulations on the problem of estimating the cost of an agent that is stabilizing the unstable equilibrium of a pendulum.Comment: Submitted to The 62nd IEEE Conference on Decision and Contro

Double Deep-Q Learning-Based Output Tracking of Probabilistic Boolean Control Networks

In this article, a reinforcement learning (RL)-based scalable technique is presented to control the probabilistic Boolean control networks (PBCNs). In particular, a double deep- $Q$ network (DD $Q\text{N}$ ) approach is firstly proposed to address the output tracking problem of PBCNs, and optimal state feedback controllers are obtained such that the output of PBCNs tracks a constant as well as a time-varying reference signal. The presented method is model-free and offers scalability, thereby provides an efficient way to control large-scale PBCNs that are a natural choice to model gene regulatory networks (GRNs). Finally, three PBCN models of GRNs including a 16-gene and 28-gene networks are considered to verify the presented results

Relationship between roots growth and forage biomass of native and cultivated grasslands of the flooding Pampa (Argentina)

Para desarrollar modelos que permitan un adecuado manejo de la producción vegetal es necesario el estudio del crecimiento de las raíces como parte del funcionamiento del sistema productivo. Las posibilidades de distribución de las raíces en el suelo, sean éstas de una especie nativa o de una exótica, dependen de las resistencias mecánicas que encuentren para elongarse y sus comportamientos serían determinantes de las diferentes producciones de biomasa aérea entre un pastizal y una pastura cultivada. Los objetivos del presente estudio fueron determinar, en cada estación climática, las forrajimasas de un pastizal natural, compuesto principalmente por pelo de chancho (Distichlis scoparia Kunth y D. spicata L.) y pasto miel (Paspalum dilatatum Poir.), y de una pastura implantada, compuesta por agropiro alargado (Thinopyrum ponticum Podp.) y trébol blanco (Trifolium repens L.), y relacionarlas a la distribución de las raíces, en un suelo Natracualf de la Pampa Deprimida Bonaerense. La materia seca aérea del pastizal y la pastura se obtuvo cortando y secando, en ambas situaciones, 10 muestras rectangulares de 0,5 m2 distribuidas al azar. La densidad radical se estimó extrayendo muestras cilíndricas a 0-5; 5-15; 15-25 y 25-35 cm de profundidad, en las mismas estaciones de muestreo de la biomasa aérea. Se determinó una mayor biomasa aérea de la pastura de agropiro en invierno y en primavera, respecto al pastizal. Las diferencias se correspondieron con la mayor densidad de biomasa radical a 0-5 cm de profundidad. A diferencia de lo que ocurrió en la pastura, a medida que aumentó la profundidad, fue mayor la correlación encontrada entre la densidad radical y la forrajimasa del pastizal.In order to get correct vegetal production management it is necessary to study root growth as a component of the productive system. In native and cultivate grassland soils, root growth possibilities depends on the mechanic resistances they found for elongation. The objectives of this research were to determine seasonal density of root biomass of both native, with salt grass (Distichlis scoparia Kunth y D. spicata L.) and dallisgrass (Paspalum dilatatum Poir.) as major contributors, and cultivate grasslands with tall wheatgrass (Thinopyrum ponticum Podp.) and white clover (Trifolium repens L.) in a Natracualf soil of the Flooding Pampa and their relationship to biomass forage. In each treatment, native and cultivate grassland, 10 samples of 0.5 m2 were extracted and aboveground dry matter was estimated. In order to assess root biomass and its vertical density distribution samples were taken, by a cylindrical technique, from 4 layers 0-5, 5-15, 15-25 and 25-35 cm. A greater winter and spring tall wheatgrass biomass forage than native grassland biomass was determined. Differences are according to the greater 0-5 cm deep root biomass. Unlike cultivate grassland, the greater the studied depth the greater the correlations between roots density and forage biomass were in native grassland.Facultad de Ciencias Agrarias y Forestale

A Multi-Step Anomaly Detection Strategy Based on Robust Distances for the Steel Industry

Steel making industries exhibit extreme working conditions characterized by high temperature, pressure, and production speed as well as intense throughput. Due to high economic and energy investments of the overall production process, an intense and expensive preventive maintenance program is adopted to avoid breakdowns. Steel making process would greatly benefit from a predictive maintenance module able to detect incoming faults from data process analysis. However, due to intense preventive maintenance, available data recording process operations enclose only a few samples of fault events, avoiding the efficient application of classical data driven anomaly detection models. In an attempt to overcome the above mentioned limits, we report the outcome of an industrial research project on data-driven anomaly detection in a steel making production process. The study assesses a fault detection strategy for rotating machines in the hot rolling mill line: we developed an automatic two-step strategy, which combines two statistical methods over the available data set: more precisely, the combination of Re-weighted Minimum Covariance Determinant estimator and Hidden Markov Models helped identify working conditions in a drive reducer of a hot steel rolling mill line and automatically isolate signs of decreasing performance or upcoming failures. The proposed strategy has been validated on real data collected in a steel making plant placed in the South of Italy

An overview of the Italian forest biodiversity and its conservation level, based on the first outcomes of the 4th Habitat Report ex-Art. 17

In 2019 the 4th Report ex-Art. 17 on the conservation status (CS) of Annex I Habitats of the 92/43/EEC Directive was expected by every EU/28 country, with reference to the period 2013-18. In Italy, the process was in charge to the Italian Institute for Environmental Protection and Research (ISPRA), on behalf of the Ministry for Environment, Land and Sea Protection (MATTM), with the scientific support of the Italian Botanical Society (SBI). A large group of thematic and territorial experts elaborated the available data concerning the 124 types of terrestrial and inland water Habitats present in Italy, 39 of which are represented by Forest Habitats (Group 9),. The main aim of the work was the evaluation of the overall CS of each Habitat by Biogeographic Region (Mediterranean, Continental and Alpine), for a total amount of 294 assessments. A high proportion of these (92, corresponding to 31% of the total) referred to Forest Habitats, including 20 marginal types for which the CS was not requested. The analysis was carried out at different scales: a) administrative territory, through the data contained in the ISPRA database, whose compilation was in charge to the Regions and Autonomous Provinces; b) Natura 2000 site, with the latest updates available (Standard Data Forms updated to 2018); c) national scale, implementing the distribution maps for each Habitat based on the European grid ETRS89-LAEA5210 (10x10 km2 mesh); d) Biogeographic Region, scale of the final assessment. Cartographic outcomes, associated databases and additional data used for the assessments will be available online on the ISPRA Portal as soon as the validation process by the European Commission will be completed. A dedicated archive named "HAB_IT" has been created in the national database "VegItaly" (1), managed by the Italian Society of Vegetation Science, where the phytosociological relevés representative of the various Annex I Habitats in Italy will be archived and freely accessible. An overview of the results regarding the Forest habitats is here provided, including a comparison with the outcomes of the former reporting cycle, the 3rd Report ex-Art. 17 (2). In several cases (e.g. 9120, 91L0), the distribution maps have been remarkably improved due to better knowledge and more fitful interpretation. The conservation status resulted as Favourable (FV) for 6,7%, Inadequate (U1) for 58,7% and Bad (U1) for 32,0% of the 72 assessed forest Habitat types. In no case there was an improvement of the conservation status, while in 6 cases a worsening of the conditions resulted from the data analysis, pointing out the Habitats types with a higher need of action. Similarly to other projects carried out as a team by the network of Annex I Habitat experts of the Italian Botanical Society and the Italian Society for Vegetation Science (e.g. 3, 4), this is another step in the direction of supporting the implementation of the 92/43/EEC "Habitat" Directive in Italy and Europe. On this ground, the high biodiversity of the Italian forest Habitats could be emphasized, however results pointed out that some rare or endemic types (e.g. Alnus cordata or Betula aetnensis-dominated forests) are still scarcely acknowledged by the most prominent EU conservation tools such as the Annex I to the "Habitat" Directive. 1) F. Landucci et al. (2012) Plant Biosyst., 146(4), 756-763 2) P. Genovesi et al. (2014) ISPRA, Serie Rapporti, 194/2014 3) E. Biondi et al. (2009) Società Botanica Italiana, MATTM, D.P.N., http://vnr.unipg.it/habitat/ 4) D. Gigante et al. (2016) Plant Sociology, 53(2), 77-8

Beta-Blocker Use in Older Hospitalized Patients Affected by Heart Failure and Chronic Obstructive Pulmonary Disease: An Italian Survey From the REPOSI Register

Beta (β)-blockers (BB) are useful in reducing morbidity and mortality in patients with heart failure (HF) and concomitant chronic obstructive pulmonary disease (COPD). Nevertheless, the use of BBs could induce bronchoconstriction due to β2-blockade. For this reason, both the ESC and GOLD guidelines strongly suggest the use of selective β1-BB in patients with HF and COPD. However, low adherence to guidelines was observed in multiple clinical settings. The aim of the study was to investigate the BBs use in older patients affected by HF and COPD, recorded in the REPOSI register. Of 942 patients affected by HF, 47.1% were treated with BBs. The use of BBs was significantly lower in patients with HF and COPD than in patients affected by HF alone, both at admission and at discharge (admission, 36.9% vs. 51.3%; discharge, 38.0% vs. 51.7%). In addition, no further BB users were found at discharge. The probability to being treated with a BB was significantly lower in patients with HF also affected by COPD (adj. OR, 95% CI: 0.50, 0.37-0.67), while the diagnosis of COPD was not associated with the choice of selective β1-BB (adj. OR, 95% CI: 1.33, 0.76-2.34). Despite clear recommendations by clinical guidelines, a significant underuse of BBs was also observed after hospital discharge. In COPD affected patients, physicians unreasonably reject BBs use, rather than choosing a β1-BB. The expected improvement of the BB prescriptions after hospitalization was not observed. A multidisciplinary approach among hospital physicians, general practitioners, and pharmacologists should be carried out for better drug management and adherence to guideline recommendations

Prescription appropriateness of anti-diabetes drugs in elderly patients hospitalized in a clinical setting: evidence from the REPOSI Register

Diabetes is an increasing global health burden with the highest prevalence (24.0%) observed in elderly people. Older diabetic adults have a greater risk of hospitalization and several geriatric syndromes than older nondiabetic adults. For these conditions, special care is required in prescribing therapies including anti- diabetes drugs. Aim of this study was to evaluate the appropriateness and the adherence to safety recommendations in the prescriptions of glucose-lowering drugs in hospitalized elderly patients with diabetes. Data for this cross-sectional study were obtained from the REgistro POliterapie-Società Italiana Medicina Interna (REPOSI) that collected clinical information on patients aged ≥ 65 years acutely admitted to Italian internal medicine and geriatric non-intensive care units (ICU) from 2010 up to 2019. Prescription appropriateness was assessed according to the 2019 AGS Beers Criteria and anti-diabetes drug data sheets.Among 5349 patients, 1624 (30.3%) had diagnosis of type 2 diabetes. At admission, 37.7% of diabetic patients received treatment with metformin, 37.3% insulin therapy, 16.4% sulfonylureas, and 11.4% glinides. Surprisingly, only 3.1% of diabetic patients were treated with new classes of anti- diabetes drugs. According to prescription criteria, at admission 15.4% of patients treated with metformin and 2.6% with sulfonylureas received inappropriately these treatments. At discharge, the inappropriateness of metformin therapy decreased (10.2%, P < 0.0001). According to Beers criteria, the inappropriate prescriptions of sulfonylureas raised to 29% both at admission and at discharge. This study shows a poor adherence to current guidelines on diabetes management in hospitalized elderly people with a high prevalence of inappropriate use of sulfonylureas according to the Beers criteria

Clinical features and outcomes of elderly hospitalised patients with chronic obstructive pulmonary disease, heart failure or both

Background and objective: Chronic obstructive pulmonary disease (COPD) and heart failure (HF) mutually increase the risk of being present in the same patient, especially if older. Whether or not this coexistence may be associated with a worse prognosis is debated. Therefore, employing data derived from the REPOSI register, we evaluated the clinical features and outcomes in a population of elderly patients admitted to internal medicine wards and having COPD, HF or COPD + HF. Methods: We measured socio-demographic and anthropometric characteristics, severity and prevalence of comorbidities, clinical and laboratory features during hospitalization, mood disorders, functional independence, drug prescriptions and discharge destination. The primary study outcome was the risk of death. Results: We considered 2,343 elderly hospitalized patients (median age 81 years), of whom 1,154 (49%) had COPD, 813 (35%) HF, and 376 (16%) COPD + HF. Patients with COPD + HF had different characteristics than those with COPD or HF, such as a higher prevalence of previous hospitalizations, comorbidities (especially chronic kidney disease), higher respiratory rate at admission and number of prescribed drugs. Patients with COPD + HF (hazard ratio HR 1.74, 95% confidence intervals CI 1.16-2.61) and patients with dementia (HR 1.75, 95% CI 1.06-2.90) had a higher risk of death at one year. The Kaplan-Meier curves showed a higher mortality risk in the group of patients with COPD + HF for all causes (p = 0.010), respiratory causes (p = 0.006), cardiovascular causes (p = 0.046) and respiratory plus cardiovascular causes (p = 0.009). Conclusion: In this real-life cohort of hospitalized elderly patients, the coexistence of COPD and HF significantly worsened prognosis at one year. This finding may help to better define the care needs of this population